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Abstract 

To fully understand the phenomenon of massive open online courses (MOOCs), it is important to 
identify and map trends and patterns in research on MOOCs. This study does so by reviewing 362 
empirical articles published in peer-reviewed journals from 2008 to 2015. For the purpose of this 
study, content analysis and discourse analysis were employed to analyze the articles. Accordingly, the 
trend line showing the number of articles per year indicates that the extent of research on MOOCs is 
likely to increase in the coming years. In terms of research areas, the findings reveal an imbalance and 
three research areas out of fifteen constitute more than half of all research on MOOCs. With regard to 
types of MOOCs, related literature is dominated by research on xMOOCs. The discourse in MOOC 
articles takes a mostly neutral standpoint, articles with a positive outlook outweigh those that are 
negative, and there is an increase in a more critical discourse. Theoretical or conceptual studies are 
preferred by researchers, although MOOC research generally does not benefit from being viewed 
through theoretical or conceptual lenses. 

Keywords: distance education, open and distance learning, Massive Open Online Courses, MOOCs, 
research trends 


Introduction 

The phenomenon of MOOCs has recently attracted considerable attention in the fields of higher 
education (HE), lifelong learning, and distance education (DE). In spite of the increasing demand and 
interest, many questions remain unanswered regarding what MOOCs really are and where they are 
heading in terms of their impact on educational institutions and educational opportunities. Among 
many published evaluations, researchers have used the following terms to refer to MOOCs: a 
disruptive innovation (Skiba, 2012; Billington & Fronmueller, 2013; Flynn, 2013); a digital tsunami 
(Auletta, 2012; Brooks, 2012; McKenna, 2012); an avalanche (Barber, Donnelly, Rizvi, & Summers, 
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2013); a revolution (Friedman, 2012); a global mega class (Bozkurt, 2016); an invasion (Krause & 
Lowe, 2014); a mania (Meisenhelder, 2013); and an educational buzzword (Daniel, 2012). In the light 
of such exuberant discussions about the “identity” of MOOCs, we believe that as a first step in 
exploring the phenomenon of MOOCs and trying to understand their past, present, and future, we 
should investigate research trends and patterns in the body of research on MOOCs. 

In this context, the aim of this study is to provide a panoramic overview of MOOC research from 2008 
to 2015 by identifying trends and patterns through a systematic review of the related literature. Within 
this perspective, the purpose of this study is to address the following research questions. 

• What are the trends in research areas? 

• What are the most researched MOOC types? 

• What discourses are dominant in MOOC research? 

• Which articles are cited the most in papers on MOOCs? 

• What are the trends in methodology and research design (or models) in papers on MOOCs? 

• What are the trends in theoretical backgrounds in MOOC research? 


Literature Review 

The increasing interest in network based lifelong learning models, that is, Massive Open Online 
Courses (MOOCs), has ignited efforts to identify trends in research on the topic. Although limited in 
number and scope, there have been valuable initiatives in reviewing MOOC research in scholarly 
articles, dissertations, and in the broadcast and social media. 

Studies in Academic Journals 

The first review study on MOOC research was conducted by Liyanagunawardena, Adams, and 
Williams (2013), who reviewed the published literature on MOOCs between 2008 and 2012. They 
identified and analyzed forty-five peer-reviewed papers. The results of their study reveal that research 
on MOOCs increased dramatically after they had been in existence in 2008; cooperative research 
efforts were popular, and research on MOOCs dealt with several domains of this topical field—from 
pedagogy and theory to technology. 

Gasevic, Kovanovic, Joksimovic, and Siemens (2014) conducted an analysis of the 266 submissions to 
the MOOC Research Initiative (MRI) in 2013, which was funded by the Gates Foundation. They 
examined the main research themes and research methodologies used in those studies. They found 
that social learning as a theme received the greatest interest, and mixed methods was the most 
preferred research approach. 
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Ebben and Murphy (2014) analyzed 25 peer-reviewed articles to identify aspects of the scholarly 
discourse on MOOCs. They identified two major phases of scholarship on MOOCs, namely 
Connectivist MOOCs, Engagement, and Creativity from 2009 to 2011/2012 (phase 1); and xMOOCs, 
Learning Analytics, Assessment, and Critical Discourses about MOOCs from 2012 to 2013 (phase 2). 

Sa’don, Alias, and Ohshima (2014) examined 164 papers published between 2008 and mid-2014 to 
identify emergent trends regarding MOOCs in higher educational institutions (HEIs). They reported 
that the top ten nascent research trends in MOOCs for HEIs (at that time) were pedagogical issues, 
assessment and accreditation, engagement or motivation, knowledge sharing, cultural diversity, 
technology, social interaction, participant retention, learning analytics, policy, and instructional 
design. 

Kennedy (2014) identified the characteristics of MOOCs in informal and post-secondary e-learning 
with a review of research conducted between 2009 and 2012. After the elimination of several articles, 
six articles were used to identify the characteristics of MOOCs. She found that openness, barriers to 
persistence, and MOOC models were the main characteristics that dominated MOOC research at that 
time. 

Veletsianos and Shepherdson (2015) conducted research by applying descriptive and inferential 
statistics to bibliometric data to investigate inter-disciplinarity in MOOC research. They examined 183 
research papers published between 2013 and 2015. They reported that education and computer 
science disciplines were the most prevalent, with a trend towards more interdisciplinary approaches 
between 2013 and 2015 (Veletsianos & Shepherdson, 2015) compared to MOOC research published 
between 2008 and 2012 (Liyanagunawardena et al., 2013). 

Raffaghelli, Cucchiara, and Persico (2015) discussed the methodological approaches in MOOC 
research between January 2008 and May 2014. Their analysis of 60 articles showed that the majority 
of research consisted of theoretical studies and case studies; and that there is a need for clear 
guidelines to identify research methodologies appropriate for the ontological and epistemological 
questions that address MOOCs. 

Sangra, Gonzalez-Sanmamed, and Anderson (2015) investigated 228 studies that focused on MOOCs 
between 2013 and 2014. They found that pedagogical strategies, learner motivation, and implications 
for HE systems were the most popular focus areas. 

Veletsianos and Shepherdson (2016) examined 183 papers on empirical studies of MOOCs published 
between 2013 and 2015, in order to identify gaps in the related literature. They found that most of the 
contributions to MOOC literature come from North America and Europe. They reported that the 
selected papers had a focus on students (83.6%), design (46.4%), context and impact (10.9%), and 
instructors (8.2%). 

Dissertations and Theses 

Bozkurt, Ozdamar Keskin, and de Waard (2016) reviewed 51 theses and dissertations published 
between 2008 and 2015. They identified that MOOCs are on the verge of the “plateau of productivity” 
as described in the Gartner Hype Cycle. Additionally, they found that, though it is a multidisciplinary 
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research avenue, MOOC research is dominated by the field of education; and researchers used 
qualitative (49%), quantitative (21%), mixed (18%), review (8%), and other (4%) research 
methodologies. They also highlighted the finding that nearly half of the theses and dissertations 
ignored any possible benefits from employing theoretical frameworks by not using them. The MOOC 
research in the theses and dissertations that were analyzed, focused on (extended) xMOOCs rather 
than on (connectivist) cMOOCs. 

Broadcast and Social Media 

Bulfin, Pangrazio, and Selwyn (2014) investigated 371 news media headlines over the preceding 24 
months within mainstream news media sources in the United States, Australia, and the UK to identify 
how MOOCs are perceived in these sources. In their analysis, they found that MOOCs are considered 
to be a portentous development for HE. 

Kovanovic, Joksimovic, Gasevic, Siemens, and Hatala (2015) examined 3958 news articles, ranging 
from 2008 to the first half of 2014, to identify MOOC-related public discourse. By using topic¬ 
modeling technique, their research revealed that while the total number of news articles followed a 
declining trend, the quality of the discussions demonstrated an increasing trend. 

Deimann (2015) examined the MOOC movement by conducting a discourse analysis of 58 articles 
published in the New York Times between 2012 and 2013. He indicated that the MOOC phenomenon 
is fueled by a net of power-knowledge relations and MOOCs contribute to a deeper understanding that 
is beyond pedagogical or economical perspectives. 

Chen (2014) investigated 306 blog posts related to MOOCs published from January 2010 to June 
2013, making use of text-mining. He reported that MOOCs provide opportunities to learners, faculty 
members, universities, and MOOC providers. He also found that challenges that MOOCs need to 
overcome include questionable course quality, high dropout rates, unavailable course credits, 
ineffective assessments, complex copyright issues, and necessary hardware required to join MOOCs. 

Finally, Shen and Kuo (2015) performed a sentiment and influencer analysis based on Twitter data 
from June 2013 to May 2014 to explore public sentiment on social media towards MOOCs. They found 
that positive tweets outweighed negative tweets, even though a slight increase in the number of 
negative tweets was evident over that time period. 

When these articles are examined in terms of their scope, it can be noticed that they covered different 
aspects of MOOC research, which makes it difficult to compare research findings with each other and 
conduct follow-up studies. The range of above review studies differ from sample size to issues covered. 
However, it is also observed that the methodological approaches, type of MOOCs, opportunities and 
challenges, use of technology in education, pedagogical approaches, social interaction, use of 
technology in education, HEIs, quality assurance, and dropout and retention rates were common 
interests in most of these MOOC reviews. 

However, one of the common issues that was salient in MOOC review studies was the cultural 
relationship and geographical distribution of the participants or authors that were interested in 
MOOCs. Liyanagunawardena et al. (2013) reported that sampled studies in their research mostly 
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presented participant demographics, which demonstrated that a large majority of participants were 
from North America and Europe. Similarly, in other MOOC review studies (Ebben & Murphy, 2014; 
Gasevic et al., 2014; Veletsianos & Shepherdson, 2016), it was reported that majority of the authors of 
MOOC studies were mainly originated from North America and Europe; followed by authors from 
Australia, Asia, or Africa. This indicates a geographical pattern for the interest in MOOC research and 
might further indicate a linguistic or cultural relationship. 

Another interesting point highlighted in MOOC review articles was the need for new methodological 
approaches resulting from complex and new nature of networked learning spaces. Thus, approaches 
such as data-mining, learning analytics, or social network analysis in MOOC research (Ebben & 
Murphy, 2014; Gasevic et al., 2014; Kovanovic et al., 2015; Raffaghelli et al., 2015; Sangra et al., 2015) 
would be helpful to analyze and interpret massive, sheer volume of data; in other words, big-data, 
distributed across the networks and globe. 

The number of sampled articles analyzed in the reviews presented above ranges from 6 to 266 articles. 
None of the above mentioned reviews regarding MOOC research analyzed the trends from the advent 
of MOOCs in 2008 all the way through to 2015. Therefore, to be able to identify and track research 
trends and patterns, there is a need for a longitudinal and inclusive review of MOOC research over 
that time period. With this in mind, this research aims to contribute to the MOOC literature by 
providing a comprehensive systematic analysis of research on MOOCs from 2008 to 2015. 


Conceptual Background 

Classification of Research Areas 

In a systematic review study, it is vital to reflect what has been done in previous research studies and 
what has been omitted. Therefore, a framework of research areas in distance education, developed by 
Zawacki-Richter (2009), was used to identify the most prominent and the most neglected areas in 
MOOC research. Zawacki-Richter’s (2009, p.7-9) framework consists of the following levels (an 
extended version is presented in Appendix A). 

Macro level: Distance education systems and theories 

1. Access, equity and ethics 

2. Globalization of education and cross-cultural aspects 

3. Distance teaching systems and institutions 

4. Theories and models 

5. Research methods in distance education and knowledge transfer 
Meso level: Management, organization and technology 

6. Management and organization 

7. Costs and benefits 

8. Educational technology 
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9. Innovation and change 

10. Professional development and faculty support 

11. Learner support services 

12. Quality assurance 

Micro level: Teaching and learning in distance education 

13. Instructional design 

14. Interaction and communication in learning communities 

15. Learner characteristics 

Reliability 

Articles included in the sample were coded by the first author of this paper, and re-coded by the 
second author, according to above-mentioned framework of research areas in DE. The extent of 
agreement between the two raters was calculated using the Kappa statistic proposed by Cohen (i960), 
which yielded an inter-rater reliability of k =0.913. A value of between 0.81 and 1.00 reflects almost 
perfect agreement (Landis & Koch, 1977), or according to Altman (1991), a value within the same 
interval is regarded as being very good. Thus, the coding of the articles according to the DE research 
areas can be considered as being acceptable, with an inter-rater value of 0.913 for Cohen’s Kappa 
statistic. 

Classification of Research Method, Designs, and Models 

Educational research is usually dominated by qualitative, quantitative, or mixed methods research. 
However, the advent of network technologies has enabled some innovative research methods based on 
specific data collection and analysis techniques such as the use of “big data” in learning analytics. In 
this sense, a new schema of research methods and models/ designs was introduced in this research. 
On these grounds, in addition to quantitative, qualitative, mixed and theoretical research 
methodologies, data mining and analytics was included. Additionally, two research methods—design- 
based research and action research—that don’t fit into any of the standard research methodologies, 
were classified as “practice-based” methodologies. 


Method and Sample 


Research Method and Design 

This paper used the method of systematic review (research synthesis) to arrive at a comprehensive 
and reliable overview of MOOC research. Systematic reviews involve three key activities: identifying 
and describing relevant research, critically appraising research reports in a systematic manner, and 
synthesizing research findings into a coherent statement (Gough, Oliver, & Thomas, 2012). Such 
reviews can provide guidance for researchers in planning future studies, as well as convenient 
summaries of the literature on a particular issue (Petticrew & Roberts, 2008). Two basic systematic 
research methodologies are aggregative and configurative reviews (Gough, Oliver, & Thomas, 2012). 
In this study, a configurative review was used, in which the synthesis is made predominantly by 
configuring data from the sampled studies to answer the review questions. 
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Sampling 

The selected articles were found by searching for using the following keywords: MOOC, MOOCs, 
Massive Open Online Course, and Massive Open Online Courses. To screen the articles, multiple 
academic databases were used; however, EBSCO, ERIC, Google Scholar, and Scopus were found to 
provide the most comprehensive search results. Searches were conducted for each year separately, 
and recurring articles were removed from the list of sampled articles. The inclusion criteria for 
sampling were: published in a peer-reviewed journal between 2008 and 2015; written in English; 
online full-text accessibility; and searched keywords to appear in the title. 

The search was limited to the time period from 2008 to 2015. The year 2008 was selected as a starting 
point since the first MOOC was run at this date, and the first example from the grey literature, that is 
to say non-conventional, non-commercial literature, was written in 2008 by Cormier (2008) who also 
invented the term “MOOC.” Though there were some articles that used the searched keywords in their 
abstracts or list of keywords (or both), we deliberately selected only those that included the keywords 
in their titles, assuming that this would identify articles with MOOCs as their focal point. 

After screening and examining 888 articles, a total of 362 articles (Figure 1) that met the inclusion 
criteria were further examined according the research questions of the study. 



2008 2009 2010 2011 2012 2013 2014 2015 


Number of the articles by year 

Figure 1 . Frequency of the sampled articles by year. 

Data Collection, Procedure, and Analysis 

The study used document analysis to collect data, content analysis to identify research trends and 
patterns, and discourse analysis to identify the tone of the selected articles. The overall research flow 
is shown in Figure 2. 
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Figure 2. The overall research flow. 


Document analysis was used to collect data and create a valid corpus based on the research questions 
and inclusion criteria stated above. Document analysis is a technique that involves skimming 
(superficial examination), reading (thorough examination), and interpretation (Bowen, 2009). During 
the initial searching and screening processes, a total of 888 papers were identified. This first corpus 
was analyzed through skimming, which yielded that 526 papers were irrelevant (articles that have 
searched keywords in the title, but do not address MOOCs in the main text), or did not meet the 
inclusion criteria; these were then excluded. Following the document analysis process, 362 empirical 
articles that were published in peer-reviewed journals were selected for further analysis. 

After the identification of the 362 articles, the researchers used content analysis, which can employ 
different methodological approaches (qualitative or quantitative or both) and a variety of data types 
(Banks, Louie, & Einerson, 2000). The use of such approaches allows researchers to make replicable 
and valid inferences from data within their context, with the purpose of providing knowledge, new 
insights, a representation of the facts, and a practical guide to action (Krippendorff, 1980). The 362 
articles or related sections were coded based on explicit rules of coding (Berelson, 1952), and 
according to pre-set categories (e.g., research method, model/ design etc.) defined by the researchers, 
keeping in mind the purpose of the research, and according to predefined research areas of DE. Some 
sections were based on counting the findings (e.g., citation analysis). The results were reported using 
trendline graphs or descriptive analysis such as frequency or percentage values. 
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In the final step, the researchers applied discourse analysis to analyze the viewpoints, perspectives, 
and aims hidden in the text, in order to reveal the position taken by the authors of each paper (Van 
Dijk, 1993). For this purpose, the conclusion sections of the papers were coded according to preset 
categories of positive, negative, neutral, and critical discourses, so as to identify the relationship 
between the text and the underlying message. 


Significance and Limitations of the Study 

This study provides a 360-degree evaluation of research on MOOCs by identifying trends and patterns 
in the field over an eight-year period. The aim is to examine the phenomenon from different aspects 
and thus provide a complete map of the field. Articles included in this research study were collected 
through an open search that provided a significant corpus of 362 articles and enabled the researchers 
to present a holistic perspective from the advent of MOOCs in 2008 to 2015. This time span is a 
sufficient period to allow the field to mature and provide sufficient data to identify trends and 
patterns. Lastly, the study not only identifies trends and patterns in MOOC research, but also provides 
a research agenda for future directions, which is important for the improvement of MOOCs in 
particular, and open, distance, and distributed learning in general. 

In addition to its significance, this study has some limitations. First of all the research corpus is 
limited only to peer-reviewed articles published in journals between 2008 and 2015. Other studies 
such as conference proceedings were not included with an assumption that not all proceedings are 
filtered through a review mechanism. However, it is thought that conducting a similar analysis would 
contribute to the literature. Secondly, as lingua franca, only articles written in English were included 
to the research to reach a global perspective. Thirdly, the articles which have online full-text access 
were included in the research corpus and those that required payment to access full-text were 
excluded. Finally, articles that included searched keywords in their titles were analyzed. The rationale 
for such an approach is that: articles that used defined keywords in their title would specifically focus 
on MOOCs. 


Findings and Discussion 

This section explains research areas, patterns (discourse analysis, MOOC types, and citation analysis) 
and trends (methodology, research design/model, and theoretical frameworks) of MOOCs 
respectively. 

Research Areas 

The classification of research areas in distance education developed by Zawacki-Richter (2009) was 
used to identify research areas in MOOCs and provide a research agenda for future studies. MOOC 
studies were analyzed and coded according to three levels of classification and fifteen research areas 
(Figure 3). On examination, it is seen that there is an unbalanced distribution among the three levels 
of classification. 
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At macro level (overall 40.4%), theories and models (27%) is the strongest emerging research area, 
since more than a quarter of the articles studied MOOCs within angle of this research area. The 
inflation in this research area also increased the overall value of the macro level. Other macro level 
research areas such as research models in DE and knowledge transfer (4.2%), globalization of 
education and cross-cultural aspects (3.8%), distance teaching systems and institutions (2.8%), 
access, equity, and ethics (2.6%) were identified as research areas that are rather neglected. 

At the meso level (overall 25.6%), quality assurance (6.1%) is the most emerging research area, which 
includes topics such as dropout rates, accreditation and quality standards. Cost and benefits (5.6%), 
educational technology (4.2%), innovation and change (4%), and professional development and 
faculty support (3.3%) are less investigated research areas. Following these, management and 
organization (1.6%) and learner support services (0.7%) appear to be the least examined research 
areas at this level. 

The micro level (overall 34.4%) is the second most studied level of classification. At this level, learner 
characteristics (15.7%) is the most examined research area, followed by instructional design (11%), 
and interaction and communication in learning communities (7.3%). 

The three most studied research areas (theories and models at the macro level; learner characteristics 
and instructional design at the micro level) constitute 53.7% of the overall corpus, which clearly 
identifies the remaining twelve research areas as those that need to be studied more. These findings 
related to research areas have revealed not only those areas that are most researched, but also those 
that are most neglected and require a special focus to improve MOOC practices. Based on these 
findings, researchers and institutions can develop a research agenda and adjust their research 
interests accordingly. 
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27%-Theories and models 
4.2%-Research methods in distance education and.. 
3.8%-Globalisation of education and cross-cultural aspects 
2.8%-Distance teaching systems and institutions 
2.6%-Access, equity and ethics 
6.1%-Quality assurance 
5.6%-Costs and benefits 
4.2%-Educational technology 
4%-lnnovation and change 
3.3%-Professional development and faculty support 
1.6%-Management and organization 
0.7%-Learner support services 
15.7%-Learner characteristics 
11%-lnstructional design 

7.3%-lnteraction and communication in learning.. 
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Figure 3. Distribution of research areas by years. 
“One study may include more than one research area 


Discourse Analysis 

The articles in the research corpus were coded (per year) according to the tone in the conclusion 
section, according to four categories: positive, negative, neutral, and critical (Figure 4). In a general 
sense, positive papers perceived MOOCs to be a hopeful innovation, while negative papers perceived 
them as hype. Neutral papers demonstrated no support for any side of the MOOC argument. Critical 
papers expressed the pros and cons of MOOCs within a holistic perspective, and provided careful 
judgements regarding their conclusions. 


According to this classification, the nature of the discourse across all the articles is 27.1% positive, 
1.1% negative, 56.4% neutral, and 15.5% critical. Based on the positive trend lines, it is possible to say 
that MOOCs will remain on the research agenda of open and distance learning. It is also noteworthy 
that very few of the papers take a negative perspective, while a considerable number of research 
articles take a critical perspective. Since critical researchers don’t take the promise of MOOCs for 
granted, they produce valuable information that can contribute to the improvement of this lifelong 
learning model. The overall outlook provides an insight regarding how MOOCs are perceived in 
academia. 
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DISTRIBUTION OF THE DISCOURSES BY YEAR 


Figure 4. Distribution of discourse in MOOC articles by year. 


On examination of Figure 4, it can be seen that the number of critical articles has been increasing 
from 2012 onwards. This may indicate that MOOCs are now being evaluated from more realistic 
perspectives, which is significant in order to build a robust research foundation. In terms of positive 
and negative discourses, the findings of this study demonstrate similar patterns with Shen and Kuo 
(2015). In their sentiment analysis, they found that public opinion in microblogging services generally 
favoured learning through MOOCs. Critical discourse in MOOC articles also has a similar pattern with 
previous research. For instance, Adams (2013) reported that the critical discourse became more 
apparent by 2013 because it was thought that MOOCs failed to achieve their promises. Ebben and 
Murphy (2014) also stated that a critical discourse about MOOCs started by 2012. In a similar vein, 
according to an analysis of public discourse surrounding MOOCs, Kovanovic et al. (2015) analyzed 
3,958 news articles and in line with the thoughts and findings of previous research, found that while 
there is a decrease in the number of MOOC-related news articles, the quality of the discussions in 
news articles appears to be increasing. They also noted that the discourse about MOOCs changed 
significantly. 


As stated in previous research, year 2012/2013 is the beginning of critical discourse that can be linked 
to high dropout rate that was diagnosed with the second generation xMOOCs which followed the first 
generation cMOOCs. We also see that how an open, free learning model, that is to say cMOOCs, was 
transformed into something semi-open, that is to say xMOOCs, and adopted freemium business 
model resulting with criticism by 2012 onwards. 

MOOC Types 

The selected articles were examined according to MOOC types (Figure 5). For the analysis, research 
articles were coded if the data was gathered in a specific type of MOOC, and theoretical/conceptual 
articles were coded if they explained MOOC types in their literature review section and provided a 
synthesis accordingly. 
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DISTRIBUTION OF THE MOOC TYPES BY YEAR 

Figure 5. Distribution of MOOC types by year. 

Interestingly, across all the articles, the number of articles (n=27; 7.5%) that focus on cMOOCs is 
relatively small since their first appearance in 2008, while there was a sudden increase in the number 
of xMOOC articles from 2013 onwards (n=n6; 32.1%). The number of articles that did not distinguish 
between the MOOC types or reported on both c- and xMOOCs (n=53; 14.7%) shows a similar pattern 
to xMOOCs. Although the number is small (n=6; 1.7%), there are some articles that report on 
hybrid/dual-layer MOOCs. 

The letters in the MOOC acronym clearly define its meaning, and the initial letters such as “c” 
(connectivist) and “x” (extended/extension) describe the main distinctions among MOOC types. 
However, a great number of the articles (0=159; 44%) neither defined the type of MOOCs they 
studied, nor clarified it in their literature review section. This creates a problematic situation in 
MOOC research and hinders the development of the phenomenon by ignoring the inherent diversity 
of MOOC types, resulting in possible skepticism about the quality and depth of MOOC research. This 
finding also aligns with the discussion in the following methodology and research design/model 
section, namely that there are a great many loosely written papers in MOOC research without a 
specific methodological focus. Such obscurity in methodological frameworks and opacity in the 
definition of MOOC types could be construed as precluding MOOCs from being both a ripe research 
realm and a promising educational practice. 

Findings of this study confirm those of both Liyanagunawardena et al. (2013) and Veletsianos and 
Shepherdson (2016), who highlighted the ambiguity in definition of MOOC types. There appears to be 
a need to define MOOC types more explicitly and explain emerging pedagogies, particularly since 
there are new experimental MOOC types such as hybrid/dual-layer MOOCs. 


Another significant point is the relatively small number of articles between 2008 and 2011 period 
when cMOOC was the only MOOC type. Although there are other sources of data that are not included 
in this study (e.g., reports and conference proceedings), there is clearly a lack of cMOOC research in 
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both periods 2008-2011 and 2012-2015. In contrast, after the first implementation of xMOOCs in 
2011, this type of MOOC experienced a sudden increase in the number of research articles about it. 

It was reported that the time period 2008-2011/12 was cMOOC dominant while 2012-2013 was 
xMOOC dominant (Ebben & Murphy, 2014). The findings of this study confirm Ebben and Murphy 
and raise an interesting fact, which indicates that the MOOC research sphere is xMOOC dominant and 
it seems that xMOOCs are being the default type. There might be many reasons regarding this trend. 
In an effort to explain the dominance of xMOOCs, Veletsianos and Shepherdson (2015) suggested that 
pedagogic approaches used in xMOOCs are well-known among the academics and very similar to 
those already have been used and widely adopted in HEIs and online learning practices, while the 
approaches used in cMOOCs are not much known and academics might be hesitant or skeptical about 
it. Accordingly, it is possible to suggest that among different MOOC types (cMOOCs, xMOOCs, or 
hybrid/dual-layer MOOCs), xMOOC research has matured and was adopted by mainstream 
education, while cMOOC and hybrid/dual-layer MOOC research needs more time to mature and 
potentially there are many issues to further explore. 

The rise of empirical MOOC research is notable from 2012 (Figure 1). MOOCs originated from 
genuine and noble ideas such as openness, connectivism, critical pedagogy, and redistribution of the 
power in learning processes to the learners; however, elite universities and xMOOC platforms are now 
major players in the MOOC field, and consequently xMOOCs have come to dominate MOOC research 
(Figure 5). The current state of the art regarding the domination of xMOOCs highlights an ongoing 
discussion: Are MOOCs a form of disruptive or sustaining innovation? The first appearance of MOOCs 
can be regarded as a disruptive innovation and they attracted a lot of attention in both public and 
academic environments. However, strategic moves from elite universities and venture capitalists have 
changed the perspective, resulting in the transformation of MOOCs from a disruptive innovation to a 
sustaining innovation. 

Citation Analysis 

A total of 11,520 references were collected from the 362 articles published between 2008 and 2015, 
thus providing a map of the most cited works in MOOC research (See the five most cited works in 
Table 1). The 74 works that are cited at least 10 times are listed in Appendix B. The citation pattern 
reveals some interesting results. The 74 works are cited a total of 1,696 times which means that they 
constitute 14.7% of 11,520 references. This distribution of references exhibits a similarity with the 
Pareto Principle (Juran, 1975), which suggests that approximately 80% of outcomes originate in 20% 
of incomes. Similarly, 14.7% of the references in the MOOC articles provide a considerable amount of 
the knowledge for the MOOC research in general. Beyond descriptive findings in regard to citation 
analysis, this finding also provides insights about knowledge production and consumption patterns in 
this scholarly area. Though covering different time periods and reported in different ranks, the studies 
listed in most cited works also overlap with those reported by Gasevic et al. (2014) and Veletsianos 
and Shepherdson (2016), which supports the idea proposed in Pareto Principle. 

Considering the wide range of MOOC papers analyzed, the works listed in Appendix B constitute the 
touchstones of MOOC research from 2008 to 2015 and provide a robust reference guide for future 
researchers. 
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Table 1 

The Five Most Cited Works 


# 

F 

References 

1 

79 

Daniel, J. (2012). Making sense of MOOCs: Musings in a maze of myth, paradox 
and possibility. Journal of Interactive Media in Education, 2012(3), Art. 18. 

2 

68 

Liyanagunawardena, T. R., Adams, A. A., & Williams, S. A. (2013). MOOCs: A 
systematic study of the published literature 2008-2012. The International Review 
of Research in Open and Distributed Learning, 14(f), 202-227. 

3 

65 

Pappano, L. (2012, November 2). The Year of the MOOC. The New York Times. 
Retrieved from http://www.nytimes.com/2012/11/04/education/edlife/massive- 
open-online-courses-are-multiplying-at-a-rapid-pace.html 

4 

62 

McAuley, A., Stewart, B., Siemens, G., & Cormier, D. (2010). Massive open online 
courses: Digital ways of knowing and learning, The MOOC model for digital 
practice. Retrieved from http://www.elearnspace.org/Articles/MOOC_Final.pdf 

5 

60 

Siemens, G. (2005). Connectivism: A learning theory for the digital age. 
International Journal of Instructional Technology and Distance Learning, 2(1), 
3 -io. 


Note. An extended list is provided in Appendix B. 


Methodology and Research Design/Model 

The findings reveal that, of all the sampled studies (n=362), conceptual/descriptive studies constitute 
the most employed methodology (53.3%) (Figure 6)—more than half of the studies that examined 
MOOCs used this methodology. They took the form of literature reviews (24.3%), position papers 
(8%), opinion papers (6.1%), reports (5.5%) and other research models. Furthermore, 
conceptual/descriptive studies constitute the majority of papers in almost each year. 

Unfortunately, though conceptual/descriptive studies have value on their own, many of the studies 
using this type of the methodology were poorly reported with a lack of empirical data, and did not 
contribute much to the literature or synthesize current literature; on the contrary, many are 
superficial reviews. In addition, the number of position and opinion papers is obtrusive. This indicates 
that many of the researchers at that time were still discussing the phenomenon of MOOCs, and 
deciding whether they were for or against it. 

Currently, most of the MOOCs are provided through learning platforms such as Coursera and the data 
needed for research are confined to these platforms. Thus, the distinctly outnumbered 
conceptual/descriptive papers further indicate the obstacles to access MOOC data, which, in turn, 
ends up with 193 conceptual/descriptive papers out of 362. 

The second most employed methodology is quantitative research (19.6%). The most commonly used 
quantitative methods were survey (12.2%), correlational (6.1%), or experimental (1.7%) studies. 
Quantitative methodology is important in being able to generalize research findings and improve the 
field horizontally; in particular, more correlational and experimental research studies are needed to 
explore the complex nature of MOOCs. 
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DISTRIBUTION OF THE RESEARCH METHODOLOGIES BY YEAR 


Figure 6. Distribution of research methodologies employed. 


The third most employed methodology is qualitative studies (14.9%). Descriptive (4.1%), case studies 
(3%), and content analysis (2.2%) were the most preferred models. In contrast to horizontal 
quantitative methodology, vertical qualitative methodology provides an in-depth perspective in 
exploring a particular phenomenon. Considering the massive and open dimensions of the MOOC, we 
believe that there is a need for more qualitative research to investigate the undiscovered nature of this 
learning model. 


Data mining and analytics follows as the next most prevalent research methodology (6.1%). Learning 
analytics (2.2%), social network analysis (1.4%), text-mining (1.4%), log analysis (1.4%), and Internet 
and traffic ranks (0.8%) were the preferred models. As an emerging research methodology, data 
mining and analytics enables a multi-layered examination of MOOCs, which are digital, networked, 
and online in nature. 


Mixed methods ranked fifth (5.5%) among the research methodologies employed in the selected 
articles. Explanatory sequential (3%) and convergent parallel (1.9%) designs were the most used in 
this category. Considering the many aspects of MOOCS that may be studied, mixed methodology is a 
powerful approach for researchers to employ, building on the strengths of both quantitative and 
qualitative data. Nonetheless, the use of mixed methods in the selected articles is relatively low. 

Practice-based studies constitute the least used type of research methodology (0.6%), with action 
research (0.6%) being the only model evident. Practice-based methodologies follow reflective, 
iterative, cyclical processes, which may be difficult for individual researchers to implement in studying 
MOOCs. Nevertheless, such studies would be favorable in contributing to promoting the success and 
sustainability of MOOCs. 

These findings confirm those of Raffaghelli et al. (2015), who reported that theoretical/conceptual 
papers constitute the majority, that is to say 23.3% of MOOC research (n=6o). They noted that mixed 
(20%), quantitative (15%), “others” (15%), qualitative (11.7%), and design-based research (8.3%) were 
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other methodologies used. In their analysis, they classified empirical articles under a research 
paradigm based on their explicit findings, or their own interpretation when the methodology was not 
explicitly stated in a study. Because no articles in the scope of the present study were classified as 
design-based research, our findings do not match those of Raffaghelli et al. (2015) in the category of 
practice-based research models. Gasevic et al. (2014), who categorized methodological approaches as 
qualitative, quantitative, mixed and other, reported a contrasting pattern with this study among the 
proposals (n=26s) submitted for funding to the MOOC Research Initiative (MRI), with preferred 
methodologies being mixed (36.2%), qualitative (27.9%), quantitative (30.2%) and other (5.7%). 

On examination of Figure 6, it can be seen that there was an increase in MOOC research from 2013 
onwards, yet more than half of the research is taken up by conceptual/descriptive studies, which is 
thought to be a handicap. Undoubtedly, some of these papers provide valuable insights, yet it is clear 
that there is an imbalance in the distribution of research methodologies among the selected articles 
(Table 2). 

Table 2 

Description of Research Methodologies and Models/Designs (n=362) 


Method 

F 

% 

Model/Design 

F 

% 

Quantitative 

71 

19.6 

Survey 

44 

12.2 

Correlational 

22 

6.1 

Experimental 

6 

1-7 

Meta-analysis 

1 

0-3 

Causal comparative 

0 

0.0 

Qualitative 

54 

14.9 

Descriptive 

15 

4-i 

Case Study 

11 

3-0 

Content Analysis 

8 

2.2 

Discourse analysis 

5 

1-4 

Ethnography 

4 

1.1 

Phenomenology 

3 

0.8 

Narrative 

2 

0.6 

Delphi 

1 

0.3 

Grounded theory 

0 

0.0 

Meta-Synthesis 

0 

0.0 

Historical 

0 

0.0 

Heuristic 

0 

0.0 

Mixed 

20 

5-5 

Explanatory sequential 

11 

3-0 

Convergent parallel 

7 

1.9 

Exploratory sequential 

1 

0.3 

Embedded 

0 

0.0 

Multiphase 

0 

0.0 

Transformative 

0 

0.0 

Conceptual/Descriptive/Other 

193 

53-3 

Literature review 

88 

24-3 

Position paper 

29 

8.0 

Opinion paper 

22 

6.1 

Report 

20 

5-5 

Systematic review 

14 

3-9 

Comparative 

7 

1.9 

Technical paper 

6 

1-7 

Reflection paper 

4 

1.1 
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Field notes 

0 

0.0 

Data mining and analytics 

22 

6.1 

Learning analytics 

8 

2.2 

Social network analysis 

5 

1-4 

Text mining 

5 

1-4 

Log analysis 

5 

1-4 

Internet and traffic ranks 

3 

0.8 

Sentiment analysis 

0 

0.0 

Practice based 

2 

0.6 

Action research 

2 

0.6 

Design-based research 

0 

0.0 


As highlighted by Veletsianos and Shepherdson (2016), dependence on particular research 
methodologies may restrict our understanding of MOOCs. Raffaghelli et al. (2015) claim that it is 
necessary to define the main constructs needed to drive empirical research; however, the sparsity of 
empirical research on MOOCs indicates an inflated debate, poorly underpinned by empirical evidence. 
In any scientific endeavour, researchers should interpret and draw conclusions from empirical data 
and a synthesis of previous findings (or both), so as to contribute to the analysis and development of 
their field. 

These research findings trigger new issues regarding research in general and MOOC research in 
particular. It is salient that the MOOC phenomenon has been studied not only by means of 
quantitative, qualitative, or mixed paradigms, but other promising methodological paradigms such as 
data mining and analytics and practice-based methodology have also been used to better understand 
MOOCs. It is clear that research methodology in the field is evolving and new methodologies are 
emerging, mostly due to advances in technology and needs stemming from the transformational effect 
of MOOCs on our viewpoints. There is an increasing tendency to use data mining and analytics also in 
other research fields to better understand the practices that are mostly online. Innovative techniques 
such as learning analytics, social network analysis, and data mining are influencing the emerging 
methodological paradigms. These techniques have been used as a methodology, research model, and 
data collection and analysis tool on their own. We also see that practice-based methodologies such as 
action research and design-based research create a research realm of their own. 

Another issue that requires attention, in terms of MOOC research, is similar to what has been found 
regarding research in the field of distance education (Bozkurt et al., 2015a). A great deal of MOOC 
articles is weak or superficial in reporting methodology and/or findings, which undermines the 
validity and reliability of their empirical research findings. In addition, abstracts and keywords, which 
are supposed to be an overall indication of the content of an article, do not necessarily reflect the key 
features of the selected studies, such as research aims, methodology, and conclusions. 

Theoretical Frameworks 

The theoretical or conceptual frameworks used in articles about MOOCs were used as a lens to 
interpret findings, and were counted and ranked according to their frequency (Table 3). It was seen 
that 64 articles (17.7%) out of 362 used employed theoretical/conceptual frameworks, while 298 
(82.3%) articles didn’t benefit from any theoretical or conceptual frameworks, or both. Those 64 
articles used 43 different frameworks, and some used more than one framework in a single study. 
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On examination of Table 3, it can be seen that theoretical or conceptual frameworks used in MOOC 
research relate mostly to the educational area, including technology, innovation, social learning, and 
independent learning. 

Table 3 

Description of Research Theoretical/Conceptual Frameworks (n=362) 


Theoretical/Conceptual 
framework 

F 

Theoretical/Conceptual 
framework 

F 

N/A 

298 

De-schooling Philosophy 

1 

Connectivism 

12 

Diffusion of Innovations Theory 

1 

Disruptive Innovation 

7 

Emergence Theory 

1 

Self-Directed Learning 

6 

Gamification 

1 

Social Learning Theory 

3 

Human Systems Approach 

1 

Chaos Theory 

2 

Implicit Theory of Intelligence 

1 

Community of Practice 

2 

Interaction Equivalency Theorem 

1 

Complexity Theory 

2 

Networked Learning 

1 

Heutagogy 

2 

Participatory Pedagogy 

1 

Item Response Theory 

2 

Persistence Theory 

1 

Rhizomatic Learning 

2 

Porter’s Copyright Interests Model 

1 

Self-Determination Theory 

2 

Porter's Five Forces model 

1 

Technology Acceptance Theory 

2 

Reasoned Action Approach 

1 

The 7CS of Learning Design 

Framework 

2 

Sociomaterial Theory 

1 

The SWOT Framework 

2 

Teaching Approach Framework 

1 

Actor-Network Theory 

1 

The Carroll Model of School Learning 

1 

Blended Learning 

1 

The Precise Effectiveness Strategy 

1 

Bloom's Taxonomy 

1 

The 7 Principles of Good Pedagogical 
Practice 

1 

Conole’s 12 Dimensions 

1 

Theory of Planned Behavior 

1 

Constructivism 

1 

Value-Based Delivery of Education 

1 

Cornell’s Information Literacy Model 

1 

Variable Cost Minimization 

1 

Deep Learning 

1 

Zone of Proximal Development 

1 


Note: One study may employ more than one theoretical or conceptual framework. 


According to Perraton (1988), research without a theoretical basis tends to be nothing more than data 
gathering, in many cases. Similarly, Bozkurt et al. (2015b) state that ignoring the use of theoretical or 
conceptual frameworks encourages researchers to report descriptive findings only. Anderson (2008) 
notes that theories allow researchers to make connections with other studies, provide deeper 
understanding of concepts, and facilitate the transformation of knowledge from one context to 
another. Referring to Immanuel Kant’s saying “theory without practice is empty; practice without 
theory is blind,” Morrison and van der Werf (2012, p.399) state that “there is a symbiosis between 
theory and practice, and, for educational research, they cannot flourish without each other, even 
though they may have difficulty in living both with and without each other.” In spite of the importance 
of using theoretical or conceptual lenses when appropriate, this analysis shows that MOOC research 
suffers from a lack of application of such frameworks. Considering the fact that MOOCs rely on many 
already known, well-established practices, such as open and distance learning, open educational 
resources, and online learning, the application of appropriate theoretical frameworks would fortify the 
pillars of research on this evolving phenomenon. 
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Conclusion and Implications for Future Research 

The results of this study reveal and describe research trends and patterns in MOOC research over the 
time period from 2008 to 2015. As can be seen in Figure 1, research on MOOCs started to expand 
from 2013 onwards, and the pattern indicates a positive trend in the coming years. The analysis 
regarding research areas in MOOCs has demonstrated that MOOC studies encompass three main 
research areas: theories and models (27%) (macro level), learner characteristics (15.7%), and 
instructional design (11%) (all at the micro level) (see Figure 3). 

In terms of the types of MOOC that appear in the research, most of the selected articles deal with 
xMOOCs (32.1%), cMOOCs (7.5%), hybrid/dual-layer MOOCs (1.7%) or c/xMOOCs (14.7). However, 
many of the articles (44%) did not explain or clarify the type of MOOC that they were investigating. 
The discourse in the selected MOOC articles tends to be positive (27.1%), neutral (56.4%) or negative 
(1.1%), with a significant number of articles exhibiting a critical stance (15.5%). 

The citation analysis reveals that the 74 most cited articles on MOOCs (n=362) constitute 14.7% of the 
citation corpus (n=n,52o). Findings related to research methodology, model, and design demonstrate 
that articles employing a theoretical, conceptual, or descriptive methodology (53.3%) outnumber 
other research paradigms such as quantitative (19.6%), qualitative (14.9%), data mining and analytics 
(6.1%), mixed (5.5%), and practice-based methodologies (0.6%). With regard to the use of theoretical 
or conceptual frameworks, 298 out of 362 articles (82.3%) reported research findings without 
benefiting from such frameworks. 

Findings of this research revealed that the least explored research areas are learner support services; 
management and organization; access, equity, and ethics. In this regard, the following implications 
can be considered for future research directions. 

First implication is based on learner support services research area from meso level. High dropout and 
low completion rates seem to be one of the major concerns of MOOC providers. Though this issue 
occupies most of the negative discussions on MOOCs, the studies concerning this issue are 
insufficient. Research on learner support services in MOOCs can contribute to the literature by 
providing effective and efficient solutions, which in turn, can be one of the solutions for the above- 
mentioned concerns. 

Second implication is based on management and organization research area from meso level. 
Supposing that MOOC participants are self-directed, self-regulated learners does not mean that these 
processes are free from management and organization processes. Considering that recent online 
learning initiatives are based on networked practices, it is for sure that management and organization 
processes differ from traditional approaches. This untapped research area can lead researchers to an 
interesting research avenue. It is also important to generate knowledge for management and 
organization issues from the perspective of MOOCs to better understand the phenomenon. 
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Final implication is based on access, equity, and ethics research area from macro level. There is a need 
for clear policies to regulate ethical considerations in research, both for MOOCs and for other 
emerging networked practices. Although most of the data on MOOCs can be gathered from open 
environments and does not require Institutional Review Board (IRB) approval, there are still ethical 
issues that are beyond informed consent form and need to be explained explicitly to provide clear 
guidelines to future researchers. 

In addition to above future research directions, considering the findings of this research study and the 
impressions gained from the studies reviewed, the following three additional recommendations are 
presented for future research. 

The first recommendation is about open policy for MOOC data. MOOC platforms should be more 
transparent and should open up MOOC data to researchers (within ethical bounds) in order to 
develop the MOOCs as a lifelong learning model and surpass the limitations imposed by the current 
majority of descriptive studies. 

The second recommendation is about cultural issues. The “M” letter in MOOC abbreviation refers to 
being massive and diverse in cultural, socioeconomic, demographic, and many other dimensions. As 
mentioned in MOOC literature, learners in MOOCs participate from diverse points of the globe; 
however, there is a tendency to participate from North America and Europe. Similarly, most of the 
MOOC research originates from these geographies. In contrast to high participation mostly from 
North America and Europe, participation from some continents shifts from moderate to low. Based on 
the idea that geography, language and culture are interrelated, MOOCs in particular and other 
networked learning spaces in general, future research can focus on geographical, linguistic, and 
cultural differences and participation. 

The final recommendation is about future follow-up research on MOOCs. This study focused on 
trends and patterns in MOOC research by compiling empirical articles that meet the inclusion criteria 
published in journals. However, as seen in Figure 1, articles on MOOCs are sparse between 2008 and 
2012. It is thought that articles published in journals require more refined and longer processes, 
which intend to present sound and solid research findings while retarding the dissemination of the 
knowledge quickly especially in emerging fields such as MOOCs. Considering that the inception of 
MOOCs dates back to 2008 and the interest arouses around 2012, a complementary follow-up 
research that focuses on proceedings would be helpful to know more about early days of MOOC 
phenomenon and would provide a deeper understanding and a comprehensive perspective. 

In conclusion, these research findings raise another question: Should HE perceive MOOCs as a threat, 
a disruptive innovation, or a change agent for sustainable innovation that might serve as a catalyst for 
the transformation of higher education? This again provides an impetus for further investigation and 
debate. 
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Appendix A 


Research Areas of Distance Education (Zawacki-Richter, 2009) 

_ Macro level: Distance education systems and theories. _ 

1. Access, equity, and ethics: The democratization of access to DE afforded by new media and by finding ways to 
deliver high-quality education to those who have limited resources and poor infrastructure; Issues that refer to the 
(sustainable) provision of DE in developing areas. What is the impact of DE (e.g., via mobile learning) on narrowing 
the digital divide and what is the role of ICT (information and communication technologies) and/or OER (open 
educational resources) in terms of access to education? 

2. Globalization of education and cross-cultural aspects: Aspects that refer to the global external 
environment and drivers, the development of the global DE market, teaching and learning in mediated global 
environments, and the implications for professional development. 

3. Distance teaching systems and institutions: DE delivery systems, the role of institutional partnerships in 
developing transnational programmes, and the impact of ICT on the convergence of conventional education and DE 
institutions (hybrid or mixed mode). 

4. Theories and models: Theoretical frameworks for and foundations of DE, e.g., the theoretical basis of 
instructional models, knowledge construction, interaction between learners, or the impact of social constructivism 
learning theories on DE practice. 

5. Research methods in distance education and knowledge transfer: Methodological considerations, the 
impact of DE research and writing on practice, and the role of professional associations in improving practice. 

Literature reviews and works on the history of DE are also subsumed within this area. _ 

_ Meso level: Management, organization, and technology. _ 

6. Management and organization: Strategies, administration, and organizational infrastructures and 
frameworks for the development, implementation, and sustainable delivery of DE programmes. What is required for 
successful leadership in DE? DE and policies relating to continuing education, lifelong learning, and the impact of 
online learning on institutional policies, as well as legal issues (copyright and intellectual property). 

7. Costs and benefits: Aspects that refer to financial management, costing, pricing, and business models in DE. 
Efficiency: What is the return on investment or impact of DE programmes? What is the impact of ICT on the costing 
models and the scalability of DE delivery? How can cost effective but meaningful learner support be provided? 

8. Educational technology: New trends in educational technology for DE (e.g., Web 2.0 applications or mobile 
learning) and the benefits and challenges of using OERs, media selection (e.g., synchronous vs. asynchronous 
media), technical infrastructure and equipment for online learning environments, and their opportunities for 
teaching and learning. 

9. Innovation and change: Issues that refer to educational innovation with new media and measures to support 
and facilitate change in institutions (e.g., incentive systems for faculty, aspects referring to staff workloads, 
promotion, and tenure). 

10. Professional development and faculty support: Professional development and faculty support services as 
a prerequisite for innovation and change. What are the competencies of online teachers and how can they be 
developed? 

11. Learner support services: The infrastructure for and organization of learner support systems (from 
information and counselling for prospective students about library services and technical support to career services 
and alumni networks). 

12. Quality assurance: Issues that refer to accreditation and quality standards in DE. The impact of quality 
assurance and high quality learner support on enrolments and dropout/ retention, as well as reputation and 

acceptance of DE as a valid form of educational provision. _ 

_ Micro level: Teaching and learning in distance education. _ 

13. Instructional design: Issues that refer to the stages of the instructional design process for curriculum and 
course development. Special emphasis is placed on pedagogical approaches for tutoring online (scaffolding), the 
design of (culturally appropriate) study material, opportunities provided by new developments in educational 
technology for teaching and learning (e.g. Web 2.0 applications and mobile devices), as well as assessment practices 
in DE. 

14. Interaction and communication in learning communities: Closely related to instructional design 
considerations is course design that fosters (online) articulation, interaction, reflection, and collaboration 
throughout the learning and teaching process. Special areas include the development of online communities, gender 
differences, and cross-cultural aspects in online communication. 

15. Learner characteristics: The aims and goals of adult learners, the socioeconomic Background of DE 

students, their different learning styles, critical thinking dispositions, and special needs. How do students learn 
online (learner behavior patterns, learning styles) and what competencies are needed for distance learning (e.g., 
digital literacy)? _ 
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